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(Dated: February 7, 2008) 

We present measurements of the branching fractions for the three-body decays B° — > D^'T K°n ± 
and their resonant submodes B° — > D^*'^K using a sample of approximately 88 million BB pairs 
collected by the BABAR detector at the PEP-II asymmetric energy storage ring. We measure: 

B (B° -» D^K ^) = (4.9 ± 0.7 stat ± 0.5 syst ) x 10" 4 , 
B(B° -► D'^K **) = (3.0 ± 0.7 sta t ± 0.3 syst ) x 10~ 4 , 
B(B° - = (4.6 ± 0.6 stat ± 0.5 syst ) x 10" 4 , 

B(B° D^ifi) = (3.2 ± o.6 sta t ± 0.3 syst ) x lO" 4 . 

From these measurements we determine the fractions of resonant events to be f(B° — > D^Tf**) = 
0.63 ± 0.08 stat ± 0.04 syst and f(B° -» D^K^) = 0.72 ± 0.14 stat ± 0.05 syst . 

PACS numbers: 13.25.Hw, 14.40.Nd 



Several independent measurements are needed to test 
the Standard Model description of CP violation. The 
angle 7 can be determined using decays of the type 
The experimental challenges are 
color suppression of the b — > zt transition, reconstruction 
of 13° CP eigenstates, and interfering doubly-Cabibbo- 
suppressed decays (DCSD) Q- Also, two-body mode 
analyses are complicated because there are eight degen- 
erate solutions for 7 in the interval [0, 2tt]. 

In recent papers 0, Q three-body decays have been 
suggested for measuring 7, since these do not suffer from 
the color suppression penalty. Furthermore, the channels 
B° — > D(*)^K°ir^ do not have the above problems with 
CP states and DCSD interference, and can resolve most 
of the ambiguities |3( • The angle 7 can be extracted from 
a time-dependent Dalitz analysis of these decay modes. 

The analysis presented here is based on 81.8 fb _1 of 
data taken at the T(4S) resonance, corresponding to ap- 
proximately 88 million BB pairs, with the BABAR de- 
tector 5] at the PEP-II storage ring. We measure the 
branching fractions of the B° — > D^^K ^ decays and 
consider their distribution in the Dalitz plot. 

We reconstruct D + mesons in the decay mode 
K~ir + ir + and D* + mesons in the mode D°tt + , with the 
D° decaying to K~tt + , K~ir + Tr°, and K^tt + tt^tt + . Here 
and throughout the paper charge conjugate states are im- 
plied. Tracks from the D decay are required to originate 
from a common vertex. Positive kaon identification is 
enforced on kaons from D meson decays, except for the 
L>° -> K-n+ mode. 

The D + candidates are required to have a mass within 
12 MeV/c 2 (2cr) of the D+ mass, while the mass of D° 
candidates decaying to charged daughters only is required 
to lie within 15 MeV/c 2 (2.5a) of the D° mass, where a 
is the experimental resolution. The D a — > K~tt + it q can- 
didates are required to have a mass within 30 MeV/c 2 
(2.5a) of the D° mass and to be located at a point in the 
D° Dalitz plot where the density of events is larger than 
1.4% of the maximum density. 

The D* + candidates are accepted if the mass differ- 



ence TOc»+ —Tripa is within 2 MeV/c 2 (3cr) of the nominal 
value, except for the D° — ► K~ir + ir° candidates where 
we use 1.5 MeV/c 2 to reduce this mode's larger combi- 
natoric background. 

We combine oppositely-charged tracks from a common 
vertex into K® candidates. The K® candidates are re- 
quired to have a mass within 7 MeV/c 2 (3a) of the K® 
mass and a transverse flight length that is significantly 
(4er) greater than zero. 

To form B° candidates, the D^*' + candidates are 
combined with a Kg candidate and a 7r~, for which 
the particle identification (PID) is inconsistent with be- 
ing a kaon or an electron. The probability of a com- 
mon vertex is required to be above 0.1%. Using the 
beam energy, two almost-independent kinematic vari- 
ables are constructed: the beam-energy substituted mass 

toes = \J (Vs/2) 2 — p* B 2 '', and the difference between 
the B° candidate's measured energy and the beam en- 
ergy, AE = E* B — y/s/2. The asterisk denotes evalu- 
ation in the T(4S) CM frame. B° candidates are re- 
quired to have AE in the range [—0.1,0.1] GeV, and 
toes in the range [5.24,5.29] ([5.20,5.288]) GeV/c 2 for 

D^K°TT ± (D*^K°TT ± ). 

To suppress the dominant continuum background 
events, which have a more jet-like shape than BB events, 
we use a linear combination, J 7 , of four variables: Lq — 
J2iPi> L2 = J2iPi\ cosflil 2 , and the absolute values of 
the cosine of the polar angles of the B momentum and 
of the B thrust direction Here, pi is the momentum 
and 8i is the angle with respect to the thrust axis of the 
signal B candidate of the tracks and clusters not used to 
reconstruct the B. All of these variables are calculated in 
the CM frame. The coefficients are chosen to maximize 
the separation between signal Monte Carlo and 9.6 fb _1 
of continuum events from data taken 40 MeV below the 
T(4S) resonance (off- resonance data). J- has negligible 
correlations with Toes and AE. 

After the event selection, approximately 5% of the 
events have more than one B° candidate. We choose the 
one with mu closest to the expected value and correct 
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for differences between data and simulation. In simu- 
lated signal events, the final selection is 19.3% efficient 
for B° -► D t K°tt ± and 15.5%, 3.9% and 8.2% efficient 
for B a -> D*^K a n ± in the three D° decay modes K~it + , 
K~Tr + ir° and A'~7r + 7r~7r + , respectively. 

We perform an unbinned extended maximum likeli- 
hood fit with the variables to-eSj AE, and T on the se- 
lected candidates, using the logarithm of the likelihood: 



ln£ 



= ln f^N^im^AE,^) j (1) 

i— events \ j / 3 



where i^y is the product of probability density func- 
tions (PDFs) for event i of toes, AE, and T, and Nj 
is the number of events of each sample component j: sig- 
nal, continuum, combinatoric BB decays, and BB events 
that peak in toes but not in AE signal region (denoted 
peaking BB background). 

The signal is described by a Gaussian distribution in 
toes i tw° Gaussian distributions with common mean in 
AE, and a Gaussian distribution with different widths 
on each side of the mean ("bifurcated Gaussian distri- 
bution") in T. Their shape is obtained from the high- 
statistics data control samples B° — ► D^^af (similar 
topology of the final state as the signal) for to.es and 
AE, and B° — > D*^^ for T , and all nine parameters 
are fixed in the fit. 

The continuum and combinatoric BB backgrounds are 
described by empirical endpoint functions |8| in wes, lin- 
ear functions in AE, and bifurcated Gaussian distribu- 
tions in T. The T distribution of continuum is obtained 
from off-resonance data, while the T distribution of the 
BB backgrounds is obtained from Monte Carlo simula- 
tion, and compared with data in high-statistics samples 
to ensure that there is no significant difference. The two 
T distributions and the common endpoint in toes are 
fixed in the fit, while the toes shape and AE distribu- 
tions are left free to float, leaving four out of eleven pa- 
rameters free in the fit. 

The peaking BB background is parametrized by a 
Gaussian distribution in Toes, an exponential distribu- 
tion in AE, and shares the PDF in T with the non- 
peaking BB background. The mean and width in toes of 
the peaking BB background are fixed to values obtained 
from Monte Carlo simulation, which are consistent with 
values measured in AE sideband of data, thus adding 
one free and two fixed parameters. 

The likelihood function is determined by the 27 param- 
eters described above, of which all four yields and five 
background shape parameters are fitted. Subsequent to 
the fit, possible residual backgrounds from combinatoric 
D and K® candidates are estimated using the sidebands 
of tod and m K o, and subtracted. 

The three-body and quasi-two-body (that is B Q — > 
£)(*)tj^*±) branching fractions are obtained by fitting 
first without regard to event positions in the Dalitz plot, 
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FIG. 1: mES distributions in data for the four decay modes. 
Events appropriately weighted by W. ig (see text) to exhibit 
the signal distribution |9| are shown as solid points over which 
the fitted signal PDF is superimposed. For comparison, the 
mES distribution obtained with \AE\ < 25MeV (2a) is in- 
cluded (dotted points). 



and then with the requirement that the K®ir + invariant 
mass lies within 100 MeV/c 2 of the K*+{892) mass. Due 
to the relatively small number of background events in 
the second fit, all BB shape parameters are kept fixed to 
the value obtained in the first fit. 

The results are shown in Fig.^ while yields and puri- 
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ties (defined as N sie /cr 2 (N Bie )) are listed in Tabled with 
the K* + resonant part included in the three-body state. 
To determine the three-body branching fractions opti- 



TABLE I: Signal yields and purities. 



Decay mode 


Signal yield Purity 


B u 


-» D*K% ± 


230 ± 24 40 % 


B° 


-> D^K** 


143 ± 14 73 % 


B° 


-» D^K ^ 


134 ± 17 46 % 


B° 


-> D*^K*± 


78 ± 10 78 % 



mally a mapping of the efficiency across the Dalitz plot 
is needed. This is obtained from simulated signal events. 
Incorporating the efficiency variations (~ ±30%) across 
the Dalitz plot requires a measure of the (apriori un- 
known) event distribution in the Dalitz plot. We obtain 
the number of signal events from the likelihood fit using 
weights defined as: 



Wl 



E J -v.. g ,j^i(^Es,A£;,J0 

NjPijim^AE,?) ' 



(2) 



where Nj and Py are defined as in Eq. (JIJ, and V sigJ is 
the signal row of the covariance matrix of the component 
yields obtained from the likelihood fit. These weights 
W 8 l } , which in the absence of correlations are signal prob- 
abilities P Big /P to tai, contain the signal distribution and its 
uncertainty for any quantity uncorrelated with the vari- 
ables in the likelihood fit [9j . 

The efficiency-corrected Dalitz distributions, weighted 

reso- 
and 



by W slg , are shown in Fig. |2] 
nance is dominant in both the 



The 
B° - 



K*(892)- 



B a — > D*^K°tt modes, while no other resonant struc- 
tures are significant. In the B° — > Z? T i4T°7r ± chan- 
nel, the spin-1 K*^ meson has the helicity distribution 
dN/d cos 8 oc cos 2 9, where 9 is the angle between the 
K*^ and the K° in the K*^ center of mass frame. This 
can be seen in Fig. 

The systematic errors are summarized in Table [H] 
Most systematic errors are due to possible differences 
between data and Monte Carlo. The tracking efficiency 
residuals and associated systematic error are obtained 
from a large sample of r decays. The efficiency correction 
as a function of the position in the Dalitz plot obtained 
from simulated signal events comes with systematic un- 
certainties due to resolution effects and binning, which 
are mostly of statistical origin. A ±lcr variation of all 
fixed variables in the fit, including relevant correlations, 
is used to obtain the systematic from the uncertainty in 
the PDFs. 

Our final branching fraction results, weighting the 
three D° modes according to their combined statistical 
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FIG. 2: Signal Dalitz distributions with events weighted by 
W S i S and corrected for efficiency variations. Each bin is col- 
ored according to its contribution to the branching fraction. 
The bins in white also include the contributions which are 
negative but still statistically compatible with zero. 
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cos(9) 

FIG. 3: Distribution of cos# for data for the B° -> D^K ^ 
decay mode in the K region using the signal weights W s i e 
and correcting for efficiency variations. The solid curve shows 
the expected spin-1 distribution dN/d cos 6 oc cos 2 0. 



and uncorrelated systematic error, are: 

B{B° -> D T K°n ± ) = (4.9 ± 0.7 sta t ± 0.5 syst ) X 1(T 4 , 
B{B° D^K **) = (3.0 ± 0.7 sta t ± 0.3 syst ) x 10" 4 , 
B(B° -» D^K**) = (4.6 ± 0.6 sta t ± 0.5 syst ) x 10~ 4 , 
B{B° -> D^K**) = (3.2 ± 0.6 sta t ± 0.3 syst ) x 10" 4 . 
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TABLE II: Sources and sizes of systematic errors. The com- 
bined errors take correlations into account. All numbers are 
in percent. 



Systematic 


DKtt 


DK* 


D'Ktv 


D* K* 


Tracking efficiency 


5.9 


5.9 


6.1 


6.3 


PID efficiency 


2.2 


2.0 


2.0 


2.0 


B(D*+) 




_ 


0.7 


0.7 


B(D +/0 ) 


■ 


6.5 


3.4 


3.8 


D'*' reconstruction 


0.7 


0.7 


1.2 


1.2 


K* + fraction fit 




3.7 




5.1 


B(K°) 


0.2 


0.2 


0.2 


0.2 


Kg reconstruction 


1.8 


1.9 


1.9 


1.9 


7T° reconstruction 






0.8 


1.2 


PDF parametrization 


4.5 


2.9 


7.1 


3.7 


Efficiency variation 


3.5 


4.9 


6.3 


5.6 


BB counting 


1.1 


1.1 


1.1 


1.1 


Combined error 


11.0 


11.6 


12.6 


12.2 



factories. 
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To summarize, a clear signal is seen in both the 
B° D t K°tt ± and B° D^K ^ channels, and 
in both modes the K*(892) + resonance is dominant. 
Defining the K* resonant fractions, /, as B(B° — > 
D (*)t k *±) B ( K *+ K°ir+)/B(B° D^K ^), we 
obtain the fractions f(B° -> D^K*^) = 0.63±0.08 sta t± 
0.04 syst and f(B° -> D^K*^) = 0.72 ± 0.14 sta t ± 
0.05 sys t, respectively, where the systematic errors are 
mainly from correcting for any possible non-resonant con- 
tributions. 

Both the method of this analysis and the resulting three- 
body branching fraction measurements arc the first of 
their kind, while the resonant decay modes have been 
measured before |lfll |. To determine the sensitivity to 7 
of these modes, a time-dependent Dalitz fit is required, 
for which the data sample is inadequate. However, the 
branching fractions and Dalitz distributions suggest that 
these modes will be useful for measuring 7 at the B- 
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